Persuasion Attacks Can Decrease Effectiveness of CoT Monitoring
Researchers found that chain-of-thought monitoring of AI agents can be counterproductive under adversarial persuasion attacks, increasing approval of harmful actions by 9.5%. A fact-checking framework…